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1. Introduction 

The replica formalism, see e.g. pQ, has proven to be a very powerful tool in the study 
of both statics and dynamics of disordered systems. In statics the presence of frozen 
disorder in the Hamiltonian makes a direct equilibrium statistical mechanical analysis 
very difficult. Instead, one starts from the key assumption (supported by numerical, 
experimental and sometimes analytical evidence) that in the thermodynamic limit the 
free energy per degree of freedom in such systems is self averaging, i.e. identical to its 
disorder average for any given realization of the disorder, with probability one. This 
property allows one to focus on the evaluation of the disorder-averaged free energy per 
degree of freedom, which for a disordered system of A" interacting discrete spins <jj 
(i = 1 . . . N) in equilibrium at inverse temperature (3 = T _1 is calculated using the 
following identity: 

/= - lim -3-lim-log^ Z = Ye~ pH{fT) (1) 

Here cr = [a\ , . . . , a^) , H(cr) is the Hamiltonian, and 777 denotes an average over 
the disorder variables of the model under consideration. The replica method involves 
changing the order of the limits n — ► and A" — > oo, and subsequently writing the n-th 
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moment of the partition function Z in terms of n copies (or replicas) of the original 
system. The disorder average then converts the original problem of n independent but 
disordered systems into a new problem for n coupled but disorder-free ones. In the 
limit iV — > oo this new non-disordered problem can often be solved with conventional 
methods, e.g saddle point integration. The limit n — > has to be taken in the final 
result. This procedure has over the years been applied with great success to many 
families of mostly range-free or mean-field models. 

Application of the replica formalism to finite dimensional spin models with 
disordered bonds and/or fields leads to the notion of replicated transfer matrices [21 E|- 
For disordered one dimensional Ising spin chains, for instance, the replica method 
effectively replaces an expression for the free energy in terms of products of 2 x 2 
random transfer matrices (see e.g. jl] for transfer matrix methods) by an expression for 
an n-replicated chain without disorder but with a more complicated 2" x 2™ transfer 
matrix which couples the n replicas at each site of the chain. In the thermodynamic 
limit one first has to find the largest eigenvalue of this replicated transfer matrix, and 
subsequently find its analytic continuation for n — > 0. It was shown in [2] that for the 
one dimensional Ising model with random bonds and fields this procedure yields the 
results obtained earlier by other techniques, see e.g. jSUHllZl- Moreover, it was found 
that the smaller eigenvalues of the replicated transfer matrix contain information about 
disorder-averaged two-spin connected correlation functions. 

In this paper we show how the replicated transfer matrix of disordered Ising models 
can be diagonalized, by using a particular form for the eigenvectors which transforms 
the original eigenvalue problem into an eigenvalue problem for integral operators. We 
believe our method to have a number of possible advantages. It appears more direct and 
explicit than existing approaches, it can be generalized in a straightforward manner to 
situations with RSB (which could for instance be induced by super-imposed long-range 
bonds), and it does not rely on the limit n — > being taken (so that it can also be used 
for finite n replica calculations describing models where the disorder is not truly frozen 
but evolving on very large time scales, in the sense of ^01 EU E21 Ej)- 

We first apply our ideas to Ising chains with random bonds and fields, where we 
can compare the results obtained with our method to those obtained earlier by others. 
Furthermore, mathematically one may express replicated transfer matrices of models 
which are not purely one-dimensional (due to super-imposed long range bonds) in terms 
of those corresponding to random field chains, with the statistics of the random fields 
mediating the mean-field effect of the long range bonds on a given site. We apply our 
equations to two examples of such models with one-dimensional and long-range bonds: 
the l + oo attractor neural networks of [I5JQ21, and the 'small- world' ferromagnet of |17j . 
and show how one can use our methods to calculate various thermodynamic quantities. 
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2. Definitions 

In this paper we will deal with disordered Ising spin systems in thermal equilibrium, 
of size N and with microscopic states written as cr = (en, . . . , a^) G { — 1, 1}^. More 
specifically, we will analyze the following three models, by diagonalizing the replicated 
transfer matrices which they generate: the disordered Ising chain (DIC) as in [SI IE], 
the (1 + oo)— dimensional attractor neural network (ANN) as in |15| Ho] and the 'small 
world' ferro- magnet (SWM) of which are defined by the Hamiltonians 

#dicO) = - J i a i a i+i - £ <Vi ( 2 ) 



Jt 

J 



Hann(ct) = - J s • _ ^ S wAti ■ Zj) ( 3 ) 



-^SWm(ct) = -J ^Vj(7j +1 ^CijO-iO-j (4) 



In d2J we have a ID spin chain with independently identically distributed random bonds 
and fields {Jj,^} at each site, drawn from some joint distribution p(J,9). We will 
abbreviate JdJd^ p(J,9)f(8,J) = (f(J,9))j t g. In (J3J) we have both ID and long-range 
random bonds, but their values are not independent. The short- and long-range bonds 
take the values J s (£i • an d JeN' 1 ^ ■ £•), respectively, where the binary vectors 
£i = {£},-■■ , Cf) represent stored data and are drawn randomly and independently from 
{ — 1, 1} P (with uniform probabilities). Finally, in (J3J) we have uniform ID ferromagnetic 
bonds of strength J , and the randomness is solely in the realization of the long range 
bonds. The latter are also ferromagnetic, of strength J/c if present, but constitute 
a finitely connected Poissonian graph defined by dilution variables c^- which for each 
pair are drawn independently from p{cy) = ^ CiJ ,i + (1 — ^)^c 4j ,o- The average 
connectivity c will remain finite in the thermodynamic limit. In all three cases (J2I3I4|) 
the ID short-range interactions are defined periodically. 

At this stage, let us briefly recall from [2J0] how a replicated transfer matrix emerges 
for the disordered Ising chain (0) upon applying the replica identity (0). Here one finds, 
with a = 1 . . . n and with the short-hand o-j = (cr?-, . . . , af) G { — 1,1}™, 

z*= E uterx^***?:.*) =iX (r;) (5 ) 



with a 2 n x 2™ matrix T n whose entries are given by 

T„(cr, cr') = ( e ^£^+/*>E^\ (6) 



One can thus find the disorder-averaged free energy per spin in the usual manner, via 
(0) , by determining the largest eigenvalue of the replicated transfer matrix T n for integer 
n. The difficulty lies in the requirement to find an analytic expression for this eigenvalue 
for arbitrary integer n (in contrast to non-disordered chains, where the dimension is fixed 
from the start and usually small, and where direct methods can therefore be employed 
such as calculating the characteristic polynomial of the matrix and finding its zeros). 
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We will first develop our diagonalization method for the simplest case, viz. the 
chain (j2J), and subsequently show that it can also serve to generate the solution of the 
other two models (|H|4jl . which involve both short- and long range bonds, by writing 
the transfer matrices of the latter two models again in the form (JUJ), but with suitably 
defined distributions p(J, 9) of local bonds and fields. 



3. Construction and properties of eigenvectors 

3.1. A detour: the Ising chain without disorder 

Let us first turn to the simplest possible case: the ID Ising chain with bonds J and 
uniform fields 9 (without disorder), where we just have the familiar transfer matrix 

T(a, a'- 9, J) = e ^ w+ ^ (7) 

Diagonalizing (JZJ) is of course trivial j3j. Here, however, we seek a method which does 
not require knowledge of the characteristic polynomial of the matrix, so that it can be 
generalized to replicated transfer matrices with arbitrary n. To this end we introduce 
the two vectors WoN> u%[x, y] G 1R 2 , parametrized by s,/i 6 IR, and with components 

u (a;x) = e Pxa Ul (a; x, fi) = e pxa {a - y) (8) 

Inserting the candidates (JBJ) into the eigenvalue equation J2 a , T(a, a'; 9, J)u(a') = \u(o~), 
and using the general identity f(a) = e^ B+Aa ^ where A = ^ log[/(l)//(— 1)] and 
B = 7^ log[/(l)/(— 1)], for a G {—1, 1}, leads to the following eigenvalue equations: 



j3B{J,x)+f3[e+A{J,x)]a _ \ j3x<r 



e 



e /3B(J,x)+/3[e+A(J,x)]c 



Age (9) 



'A' (J, x) {a - » ) = X ie ^(a - y) (10) 



where 



A(J, x) = — arctanh[tanh(/3J) tanh(/3x)] (11) 

B(J, x) = — log[4 cosh(/3( J + x)) cosh(/3(J - x))} (12) 
Z/j 

with partial derivatives A'(J, x) = d x A(J,x) = ~[tanh(/3J + (3x) + tanh(/3J — /3x)] and 
B'(J, x) = d x B(J, x) = |[tanh(/3J + (3x) — tanh(/3J — /3a;)], respectively. We conclude 
from that if x* is the solution of the algebraic equation x = 9 + A(J, x), then Wq[:t*] 
is an eigenvector with eigenvalue Ao = e ,3B<yJ,x ''\ This (unique) solution, which can be 
viewed as the stable fixed point of the iterative map x i+ \ = 9 + A(J, xA, is given by 



x* — -(J + 9) + — log e pj sinh(/3#) + y e 2 ^ sinh 2 (/3fl) + e" 2 ^- 7 (13) 

Inserting (JT3*Jl into our expression for Ao then reproduces the familiar result for the largest 
eigenvalue of the transfer matrix of the Ising chain with uniform fields and bonds 



A = e W.**) = e pj cosh(/3#) + Je 2 ^ sinh 2 (/3#) + e" 2 ^ (14) 
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Similarly we see that if [f = j^a^Jx*)' "with x* as defined before, then also iti[x*,/i*] 
is an eigenvector with eigenvalue Ai = e /3B( - J ' x *^ A'(J, x*). Insertion of (J13J1 leads to the 
familiar expression for the second eigenvalue of (J7J): 



Aj = e^ cosh(/?0) - \je 2 ^ sinh 2 (/?#) + e~ 2 ^ (15) 

It turns out that /x* gives the average magnetization at each site: 

, tanh(/3x*) [1 +tanh(/3J)l sinh(/3fl) . . , . 

/i = 27 7 = — = = (<7j) (lb) 

l + tanh(/3 J) tanh (/3a;*) Jsinh 2 (/?#)+ e" 4 ^ 7 



Note that our expression for (J7J) is not symmetric (although one could easily write the 
partition sum in terms of a symmetric transfer matrix), hence we have to distinguish 
between left and right eigenvectors; so far only right eigenvectors have been calculated. 
We can find the left eigenvectors v via similar ansatz to (JBJ): 

v (a; y) = e^ Vl (a; y, u) = e^> - u) (17) 

Insertion into the left eigenvalue equation v {°~')T(o-', a; 9, J) = Xv(a) then reveals 
that the two vectors «o[y*] and V\ \y*,u*} are left eigenvectors, where y* is the 
solution of y* = A(J,y* + 9) and v* = j—^rfeq-^ ■ The associated eigenvalues are 
A = eW'^+^and Ai = e^ J ' y * +e ^A'(J,y* + 9). The fixed point y* of the map 
y i+i = A(J, yi + 9) is again unique, and is given by: 



y * = _( J - 9) + — log [e pj sinh(/3#) + ^Je 2 ^ sinh 2 {(59) + e"^ J 

Obviously x* = y* + 9, so left and right eigenvalues are identical and v* = \f — (ai). 
Furthermore, upon using the simple relation tanh(/3x* + /3?/*) = (crj) = fi* = v* it is clear 
that left and right eigenvectors corresponding to different eigenvalues are orthogonal: 

^v (a;y*)wi(a; £*,//) = 2cosh(/3x* + /3y*) [tanh(/3x* + (3y*) - //] = 

a 

J2M^y* ,^*)u (a;x*) = 2cosh(/?x* + /%*) [tanh(/3x* + /fy*) -v*]=0 

a 

Finally, to normalize our eigenvectors we require the constants 

D (x*,y*) = "£v (cr;y*)uo(o-,x*) = 2cosh(f3x* + f3y*) (19) 

cr 

D l (x*, y*) = Y, vi (cr; y\ //>i (a; x\ fi*) = 2 cosh(/3x* + f3y*) [l - (/i*) 2 ] (20) 

cr 

3.2. Uncoupled replicated chains 

As a intermediate step from the the diagonalization of (J7J) for the simple Ising chain 
to diagonalization of (JHJ) for disordered chains, let us now inspect replicated transfer 
matrices with uncoupled replicas, viz. © but with (^-distributed bonds and fields: 

T n ((T,(T';9,J) = e^Ea^+^Ec^ (21) 

without an average over {9, J}. This matrix is just the n-fold Kronecker product of 
(J7J), so its left- and right eigenvectors are simply (Kronecker) products of (fT7J) and (JBJ), 
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respectively. Each eigenvector is characterized by an index set {p} C {1, . . . ,n} of size 
p G {0, . . . , n}, indicating those indices a for which we select iti[x*] as opposed to ii [a;*] 
(and similarly for left eigenvectors), and with {0} = 0. The left- and right eigenvectors 
of (|21|) can thus be written as 

v{ P }{(T]y\p*) = n v i(v a ;y*,v*) II M^y*) (22) 

ae{p} a(£{p} 

u {p} (cr;x*,p*) = J[ Mi(cr Q ; x* , p*) H u (o a ]x*) (23) 

ae{p} a£{p\ 

For each p G {0, . . . , n} there are (^j different index subsets, giving us the required 
total number of 2 n eigenvectors. The associated eigenvalues follow easily, since here all 
spin summations factorize over replicas: 

T n ((T, cr'; 9, J)u {p} ((T f ; x*, p*) 

cr' 

= KK~ P II M^'a, x * i V*) II M o(o"«;a;*) = A?Ao _p M M (cr;x*,/i*) 

ae{p} a(£{p} 

Hence (|2*T|) has n + 1 different eigenvalues A p (n) = \1\q~ p } each with multiplicity (j^J. 
Since A > Ai, we also have the ordering relation Ao(n) > Ai(n) > . . . > A n (n). We can 
furthermore see that right and left eigenvectors satisfy the orthogonality relations 

p 

V{ P '}[y*,V*] ■ u {p} [x\p*} = D p (x*,y*)5 pp/ J] $a h «' h (24) 

k=l 

D p (x*,y*) = 2cosh n ((3x*+(3y*) [l - {p*f] P (25) 

where {p} = {a>i, . . . , a p } and {p'} = {a[, . . . ,a' p ,}, and where the factor n&=i ^a k a' m 
(|2*4*jl is defined as unity for p = 0. 



3. 3. Diagonalization for the disordered Ising chain 

We now turn the real problem: the diagonalization of (jBJ), which can also be written as 
T n = (T n [9, J])e,j- Clearly T n shares many properties with T n [9,J], e.g. invariance 
under all permutations 7r of the permutation group S n acting on the indices {1, . . . , n}: 

T n (7r(er),7r(er')) = T n ((T, cr') for every 7r G S n (26) 

It follows that if u is an eigenvector of T n with eigenvalue A, then so is D^u for any 
7r G S n where D n denotes the matrix representation of ir, i.e. D n (er,er') = S^cr),(j'- 
In the uncoupled case pijl one observes that D 7r it{ air „ >a y = it{ 7r (oi),...,7r(a»)} f° r every 
7r G S n ] we will make the ansatz that this also holds for the eigenvectors of (|26j). The 
result is again a spectrum of n + 1 different eigenvalues A p (n) with p — 0, 1, . . . , n, with 
multiplicity (j^j each. These statements reproduce the results in [2], which were derived 
using the irreducible representations of the replica permutation group. Here we are now 
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being led to the following general ansatz for the right- and left eigenvectors of T n : 

u {p} (cr;P p ) = JdxdfiP p (x,n\n) e^S: =1 -« J] (a a -fi) (27) 



a€{p} 



Q p )= JdyduQ p (y,u\n) e^l=i°" ]J (a 



(2f 



ad{p\ 



with P p and Q p denoting functions to be determined, by inserting (}2*T|) into the right 
eigenvalue equation T n u^[P p ] = \ p (n)u{ p }[P p ], and (|2~H|) into the left eigenvalue 
equation v^ p j[Q p ]T n = \ p (n)v{ p }[Q p ], respectively. Working out the first equation gives, 
with the definitions (|n|12j) : 



^2T n (cr,cr')u {p} ((T';P p ) = / dx'dfi' P p {x', fi'\n)( ]J 

rr* J \ . s 



^B(J,x')+f3[e+A(J,x')]a a 



a£{p} 



■Q c mJ,x')+0\O+A(J,xt)]<r aA t^ x lj/ Vj B'(J,X') 

A'[J, x') I j, 



ae{p} 



Upon inserting suitable integrals over 5— functions, viz. 1 = fdx 8[x — 9 — A(J, x')] and 

,'-B'(J,x' 
A'(J,x') 



1 = fdpL 5[fi — - A ? ( j J .',s - ], we then find our right eigenvalue equation taking the form 



dxdfi 



1 1 ■ ' r " ' " ■ 1 f# B v*n [a'(j, x')Y8[x - e - a(j, x')}6[» - M ' B ' {J > x>) 



dx dfi P p (x,fi |n)(e 



A'(J,x') Vj. 



ae{p} 



X p (n) JdxdfiP p {x,fi\n) e^SLi- J] (a a - M ) 



a£{p} 

We conclude from this that the function P p must satisfy the following eigenvalue 
equation: 

J dx'dfi' A p p) {x,fi,x',fi'\n) P p {x',fi'\n) = X p (n) P p (x,fi\n) (29) 
with the kernel 

tSp{x,n,x\n'\n) = (e n0B ^ x '\A'(J,x')} p 

H'-B'(J,x'). 



x 5[x-6-A{J,x')]5[fi 



(30) 



A'(J,x') 'Ufi 

Upon repeating the above procedure also for the left eigenvectors ()28|) we find a similar 
eigenvalue problem for the functions Q p , but now with a different kernel A^: 

dy'dv' A p Q \y,v,y',v'\n) Q p (y\v'\n) = X p (n) Q p (y,v\n) 



Af\y^yW\n) = (e nf3B ( J ' v ' +e \A' (J, y' + 9)] p 
x S[y-A(J,y'+9)]5[u- 



v'-B'(J,y'+9) 



(31) 



(32) 



A'(J,y'+0) 

We have now transformed the problem of diagonalizing the 2™ x 2™ replicated transfer 
matrix © into a problem involving integral operators ()30I32|) . where the limit n — > 
can be taken. 
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We note that, at least for the purpose at finding the eigenvalues X p (n), the two 
eigenvalue problems (j29l31|) can be integrated over p and v, respectively, and replaced 
by a simpler eigenvalue problem for the two single-argument functions $ p (x|n) = 
fdp P p (x,p\n) and * p {y\n) = fdv Q p {y,v\n): 

J dx 1 A ( p P) (x, x'\n) $ p (x» = X p {n) <$> p {x\n) (33) 

J dy' A«%, y'\n) p {y'\n) = X p (n) * p (y\n) (34) 

with 

A p p \x,x'\n) = (e nmj ' x,) [A'(J,x')} p 5[x -6- A(J,x')]) jg (35) 

A«WW = ( e ^ W+e) [A'(J,y' + ^)]^[y- A(J )2 /+0)]) j() (36) 



Once we know the functions P p and Q P , the form of the kernels (|35|3(i|) enables us 
to integrate (J2~9")) and (p?Tj) over x and y, and obtain relatively expressions for the 
corresponding eigenvalues: 



fdx $ (x\n)(e nl3B ( J ^\A'(J,x)] p ) 

A » = - — } 5 M / (37) 



/dy * p (y|n)( e ^ B (^+ e )[A'(J,y + 0)]" 
V™) = rj t / i \ ^ (38) 

Let us quickly inspect special cases. We see that for 5— distributed fields and 
bonds the integral equations (j29l31J) admit the expected solutions P p (x, p\n) = 5(x — 
x*)5(p — p*) and Q p (y, v\n) = 5(y — y*)S(u — /i*), the eigenvectors (|27I28|) reduce to the 
eigenvectors of (}2"Tj) . and the eigenvalues become X p (n) = X p Xq~ p , as they should. Also 
the special case of a chain without external fields, i.e. p(J,0) = p(J)5(9), can be easily 
solved analytically. Here A( J, 0) = B'(J,0) = and A'(J, 0) = tanh(/9J) for every J, 
which enables us to verify that ()29I3H) have the trivial solutions P p (x, p\n) = 5(x)5(p) 
and Q p (y, u\n) = <5(y)<5(z/). Hence the eigenvectors become 

u {p} (<t) = v {p] (cr) = a « 

ae{p} 

They satisfy v p [Q] ■ u p >[P) = 2 n 5 pp > Hk=i ^a k a' k - These eigenvectors are in fact common 
to all matrices of the form T(er, a') = T(<x • cr') [Tl], and our replicated transfer matrix 
falls in this category when the external fields are zero. The eigenvalues are given by 
X p (n) = ([2 cosh(/3 J)] n tanh p (/?J)) Jy and it is clear that the largest corresponds to p — 0. 

3.4- Properties of the kernel eigenvalue problems for n — > 

Let us consider in more detail the n — > limits of the eigenvalue problems (J3U)) and 
(f3~2~|) . We first turn to p — 0. The eigenvectors corresponding to eigenvalue A (0) do 
not depend on {u, p}, so upon writing simply <^> 1 0) = $(x) and \&o (?/ 1 0) = ^(y) we 
obtain for p = 0: 

J dx' <$>(x')(8[x -9- A(J,x')]) je = A (0) (39) 



Diagonalization of replicated transfer matrices 9 

'dy f ^(y')(6[y-A(J,y' + e)]) je = A (0) *(y) (40) 

If we assume that fdx $(x) 7^ and fdy ^(y) ^ 0, then integration of (|39I40|) over x 
and y, respectively, gives us in both equations Aq(0) = 1. This, in turn, implies that 
$(x) and ^(y) are the stationary distributions of the two random maps 

= 0i + A(Ji, Xi) y i+ i = A(Ji, yi + $i) 

These maps describe the propagation of the fields x and y along the chain. The two 
distributions are connected via the following equations, 

$(x) = Jdy^{y){5[x-e-y]) e tffc/) = Jdx ®(x)(5[y- A(J, x)])j(Al) 

which can be verified upon substituting into (|39J4()j) . using Aq(0) = 1. 

The case p > is more complicated. Here we find the n — > eigenvalue problems 

J dx f d^'([A'(J,x')rS[x - 6 - A(J,x')}5[» - ^^y^ j/p^^lO) 

= A P (0) P p (x,fi\0) (42) 
dy'du'([A'(J, y'+ e)]'5[y - A(J, y'+ 0)]sL - ^r4^V^ 1 ) 70 Q P M "'M 



I 



A'(J,y' + 

= X p (0)Q p (y,u\0) (43) 

As for p = we can show that these equations admit solutions P p and Q p which 
can be interpreted as probability densities. The difference with p = 0, where these 
distributions are the stationary measures of the random maps of the propagated fields 
{x, y}, is that here the quantities which are propagated are the distributions themselves, 
via deterministic but nonlinear functional maps: 

Pp,i+1 = Ap,p(P Pt i) Qp,i+1 = ^-Q, P {Q P ,i) 



where 



[Ap tP (P)](x, fi) = Jdx' dp 



P(x',p')[A'(J,x')}P 



Jdx"dp"P(x", p")([A'(J", x")]p)j„ 



x5[x-9- A(J, x')]6[p - ^ jy^ ] ]) (44) 

A'(J,x') I j.e 



[AqAQ)Kv,v)= /V^' 



A>(J,x>) 'I Jfi 
Q(y>v')[A'(J, y '+9)y 



Jdy"du"Q(y",u")([A'(J" 1 y"+e")}p}j l ^ 

We see that the defining properties of a probability density, viz. non-negativity and 
normalization, are preserved by both functional maps. Hence we may indeed view the 



eigenvalue problems (|42|43jl as the fixed point equations of the functional maps 
The eigenvalues are: 

A„(0) = Jdx<S> p (x\0)([A'(J,x)} p )j = Jdy^ p (y\0)([A'(J,y + e)r) ej (46) 

where $ p and \& p are as before the marginals of P p and Q p . Moreover, using the property 
A(J,x) < 1 for every J,x we obtain A p (0) < Aq(0) = 1 for every p > 1. We may also 
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generalize equations (|41j) which give the relation between the solutions of the two p = 
eigenvalue problems. It straightforward to check by substitution into (j42|43J) that for 
p > 1 we have: 



P p (x, fi\0) = J dydv Q p (y, u\0) (5(x - 9 - y)) S(p - v) (47) 
fdxdpP p (x,u\0)([A'(J,x)My-A(J,x)]5[^-^^f])j 

Qp(yM0) = fdx %{ x m[ A> { j,x)n> ! — (48) 

3.5. Spectral decompositions 

Standard linear algebra guarantees that left- and right eigenvectors corresponding to 
different eigenvectors are orthogonal. This, given that our eigenvalues A p (n) depend 
only on the size p of the index sets we know that 

P^p'- Y, u {p}(^ P p) v {p'}(^Qp') = ° ( 49 ) 

It follows that we may always use the decomposition 

n 

T n (<r,<r') = £A p (n)^W) (50) 

p=0 

in which the matrices U$ are projection matrices, each formed of linear combinations 
of A p (n)-eigenvectors and each acting only in one of the orthogonal eigenspaces. We 
note that also T k n = YT p =o A* (n) 17^0 for any integer k > 0, and that the trace of 
a projection operator reduces to the dimension of the space which it projects, i.e. 
tr(U^) = PM. Since the dimensions of both the Ao(n) and the A n (n) eigenspaces 
are one, the corresponding eigenvectors are pairwise orthogonal and orthogonal to all 
other eigenvectors, and therefore 

m*y) = U{0}{ " )v , { f^ u^\.^') = u{n ^y} cTl) (5i) 

D (n) ' D n (n) 



with 



D P ( n ) = J2 v {p}( (T ) u {p}( (T ) 



(7 



Jdxdp P p (x,p\n) Jdydu Q p (y,v\n) 



p, 



x [2 cosh(/?x + (3y)} n 1 + pv - tanh(/?x + py) [p + u] (52) 

We note that lim^^o-^o^) = 1- Expression (joT?|) will prove useful in calculating 
observables such as magnetizations and correlation functions. If also within each 
eigenspace characterized by an index set size 1 < p < n — 1 the eigenvectors would 
be orthogonal (as in chains without disorder, or in the random bond chain without 
external fields), then we would have U^(tr, <r') = Y,{ P } u {p}( (T ) v {p}( a '') / D p (n) for all p, 
and hence 

P=0 {p} ^PV 1 ) 
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4. Applications of the theory: the random field Ising model 

As a benchmark test, let us first calculate the free energy and various observables for 
the random field Ising chain (J2J) with nearest neighbour bonds of strength J . 



4-1. The free energy 



We recall that the free energy is given by: / = — lim n _+ \ hrnjv-^ logtr(T^), where 
T n is the replicated transfer matrix (@). Assuming that the largest eigenvalue is A (n), 
we may write the trace as: 



n ' 



A (n) 



JV 



(54) 



trCO = £[A,(n)f tr(l/M) = A?(n) 1 + £ 

p=0 P=l \r 

Since limAr_^ 00 (A /3 <o(?7.)/Ao(n)) iV = 0, only the contribution of the largest eigenvalue 
survives, so that, upon writing Xo(n) = 1 + An + 0(n 2 ) (for we had already established 
that A (0) = 1): 



/ = ~\ lim -logAo(n) 



•4lim-log[l + nA + C(n 2 )] = -4 (55) 



The 0{n) contribution A to A (ri) can be found upon expanding (jS7j) for small n, and 
is found to be A = (3 jdx <&(x)B(J ,x). Insertion into (}55j) gives us 

1 



./ 



2(3 



dx $(x) Iog4cosh(/5(J + a:)) cosh(/3(J - x)) 



(56) 



This expression can be converted into a form more familiar from the one dimensional 
random systems literature El IHj • If we define a new random variable x and 



an associated density $(x) via $(x) 
straightforward manipulations that 

1 



where 



/ = (0)e 



$(x) 



(3 



fdx $>(x)8[x 
dx $(x) log[e pJo + xe~ pJo } 



?Wx] we g n( ^ a ft er gome 



(57) 



x 



3 2/30 



-0J(> _|_ rj,' '(?0JO 



e /3Jo _|_ x'e~P J o ' 

The resulting (correct) expression (J57|) for the free energy justifies a posteriori our 
assumption that \$(n) as generally the largest eigenvalue, and confirms that our ansatz 
for the associated right- and left eigenvectors, which are seen themselves to be replica 
symmetric (i.e. Uq(tt((t)) = Wo(cr) and t> (7r(cr)) = v ((t) for every permutation 7r G S n ), 
was correct. 



4-2. Single site expectation values and their powers 

Let us next show how single-site observables of the form ({Ti) p (integer p), with brackets 
denoting a thermal average over the Boltzman measure and TTT denoting averaging over 
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the disorder, can also be calculated. We use the following replica identity 



{<ji)p = lim [ o-ie-^W] P [ e~^( CT )] 



n—p 



n 

= limE< 1 --^r P Il^ (<TQ) (59) 
n ^ {a} a=l 

and define the diagonal 2 n x 2 n matrix S{ p y with entries 

S {p y(a,cr') = 5cr,cr' J[ <r a (60) 

ae{p} 

Upon using the replicated transfer matrix (jUJ) to evaluate (|59p. and upon dividing (jo^|) 
by 1 = lim n ^o -Z™ — lhn n _+otr(T iV ), expression ()59|) can be written in the form 

tr(S {p} T N ) 



(<n)P = lim 



For large N our spectral decomposition (JHUj) now gives us 

tr(5 w C/( ))+E^ =1 [A^H/Ao(n)] Jv tr(5 w C/^)) 



(c"i) p = lim lim 



n-0iV-,oo 1 + E^itAp'H/AoH]^ 

limtr(S {p} E/f) 



71-+0 



cr ae{p} 



= lim / dxdy$ (x|n)^ (?/|r2) [2cosh(/3x + /5y)] n tanh p (/5x + /3?/|61) 

We note that the dependence on the particular realization of the index set {p} has 
disappeared, as it should, leaving only a dependence on the size p of this set. We may 
now take the limit n — > 0, and find our transparent and appealing final result 

(ay = J dxdy $(x)V(y) tanh p (/?x + f3y) (62) 
4-3. Multiple-site observables 

Finally we apply our methods to the evaluation of disorder-averaged powers of two-spin 
correlations, of the form (oiOj) 9 with integer p. We choose j > i and start from the 
identity 



(a iaj )p = lim g^e-W^^e-W] 



n—p 



lim y a? 1 a* 1 . . . a?" a™" TT e~^ a ) 

{<T} a=l 



tr(5 M THS {p} r^ 
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Our spectral decomposition ()5(J|). together with A (n) = 1, enables us to write for 

iV -»• oo: 



En 
p'p"=0 



{(Ji(jj) p = lim lim 





"V(n)" 




A p „ (n) 





A (n) 




A (n) 



tr(5 {p} [/(f')5 {p} C/(f") 



A (n) 



lim £ A p ,(0)^ 4 tr(5 {p} [/(f')5 {p} [/(°)) 



(64) 



p'=0 



To work out the trace in (p>4"j) we write the entries of our projection matrices as follows: 
L#V, <r') = £ «W (<0 (65) 



IMI = |{?'}|=p' 



We may now write 



tr(S {p} U^S {p} U^)= £ [t, {0} (<r) [] a a ] t^VX) [u {0} (*') J[ a' a 



rr rr' 



a£{p} 



a£{p} 



£ 

Itol = !{?'}[ = p' 



V (P') 4({0},{?}) 4 ({?'},{0}) 



(66) 



with 



.({o},M) 



^ ,,w ' = £*{o>(*)««(<r) n 



aG{p} 



l({?},{0}) 

l {p} 



A V r l .V' l " J; = E"{0}( (T )%}( <T ) n °« 



<y a€{p} 

Our correlations (}6"4"j) can apparently be written in the simplified form 

AP 1 ) 4 ({0},{?}) 4 ({,'!.]()} i 

p'=0 



(^i>" = £a £ a,(o)'-< E 



(67) 
(68) 

(69) 



to, {?'} 
IMI = |{C}| = p' 



Inserting the eigenvectors ()27I28|) into expressions JSZES) for the coefficients aJ {0 /' {?}) ( 



and A 



{p} 



; followed by summation summing over the spin variables, gives 

A« } } ' W) (n) = J dxdfi P p ,{x,n\n) J dy * (y\n) 

x [2cosh(/?x + /3y)] n [l -/utanh(/3a; + /3y)]l^> n WI 
x [tanh(/3x + /3y)]'^ n WI [tanh(/3a; + 0y) - /^l^ntol (70) 



^ { p ? } } ' {0}) (n) = Jdx $ (z|n) y dydz/ Qp,(i/,i/|n) 

x [2cosh(/?x + /?y)] n [l - ^tanh(/3x + /3y)] l{p}n{t}l 

x [tanh(#c + /?y)] IWn ^l [ ta nh(/5x + (3y) - ^IMntol ( 71 ) 

These quantities no longer depend on the detailed realizations of the index sets, but 
only on the sizes of these sets and of their intersections. Let us denote the number of 
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elements in the intersection of {p} and {?} by k = \{p} fl {<?}|, k = 0, . . . , min{p, p'} 
(since |{c}| = //): 



\{ P } n {<;}{ = k, \{ P }n{,}\= P -k, \{p}n{,}\ = P '-k (72) 

with similar definitions in the case of |V}, defining the variable k! . We may now write 
(JUJ) as 

n min{p,p'} 

w^hEvr E 

p'=0 fc,fc'=0 

x E E Vg^j (73) 

W, IWI = p' {?'}, I{?'}I = p' 
IMn{?}| = fc |{ P }n{ ? '}| = fc' 

in which v4 p °^ p ^ and A^' ^ denote the n —>■ limits of (fTUj) and (fTTj) . respectively (with 
the conventions as laid down in (fT2"|) ): 

A { pf = Jdxdp P,(x,fi\0) Jdy MV\0) [tanh(/fe + /fy)]'- fc 

x [1 - ptanh(,&E + /fy)] fc [tanh(/3a; + f3y) - p] p '~ fc (74) 

^M 0) = /dz *o(^|0) | dydz/ Q^y, !/|0) [tanh(#r + 

x [1 - z/tanh(/3x + /%)] fc [tanh(/3x + /3y) - v\ p '~ k (75) 

The rigorous evaluation of the last line in (|73|) for arbitrary models requires the explicit 
calculation of the expansion factors Vra/yi- Although one can easily write formal 
expressions for these quantities in terms of the inverse of the matrix of inner products 
of the eigenvectors within a given eigenspace p', this leads as yet only to expressions in 
which it is not clear how the limit n — > can be taken. 

We can at present only push the evaluation of (|75j) to its conclusion for those cases 
where the eigenvectors within each eigenspace are either explicitly orthogonal for any n 
(as in chains without disorder, or in the random bond chain without external fields), or 
become effectively orthogonal in the n — > limit. The latter is very hard to verify or 
disprove a priori, but can serve as an efficient ansatz, to be verified later using numerical 
simulations. In these cases we are allowed to write simply l/r^Ln = D^ l {n)8^^^ and 
find (fT3|) reducing to 



It turns out that in ()76|) only the terms with k = q will survive the limit n — > 0. In 
the special case of non-disordered models, where P p (x,p\n) = 8(x — x*)5(p — p*) and 
Q p (y,u\n) = 8(y-y*)5(iy-p*), with p* = tanh(/3(x* + y*)), we see that A p °f and A^f 
vanish unless k = q. More generally we show in the Appendix that for integer p and I: 

p>l,£>0: lim ( H ~ P ) = 5t, (77) 
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It follows that the second line of (J76|) must vanish entirely since there always k < p < <j, 
whereas in the first line we retain only the terms with k = so that together with (jo^j) : 



4(0,?) 
p 

A P 



P 
<T=0 



(78) 



dxdfi P,(x,p\0) J dy V (y\0)[l - fi tanh(/3x + /3y)] s [tanh(/3a; + /3y)] p ~ ? (79) 
dx $ (x\0) J dydv Q ? (y,f|0)[l - */ tanh(/3;c + /fy)] ? [tanh(/?ai + ,0y)] p ~ t (80) 
dxd/i P p (x, /u|0) dydv Q p (y,v\0) 1 + p,v — t&iah(f3x + f3y)[/j, + v] P (81) 



This concludes our calculations for the random field Ising chain. 



4-4- Comparison with simulations 

We have tested the predictions ()62j78j) for the random field Ising chain with p{6) = 
p5{6 — 6) + (1 — p)5{6 + 6). Objects such as (<jj) 2 or (crjCXj) 2 were measured by 
simulating two copies of the system, with identical disorder realizations but each evolving 
independently according to standard Glauber dynamics towards equilibrium following 
a randomly chosen microscopic initial state. The results are shown in figure H in all 
simulations the system size was iV = 20,000 spins. We concentrated on the following 
quantities: 

m = Jj fl l = Jt E( a *^+l)' tt2 = Jj Y,( a i a i+l) ( 82 ) 

i i i 

9 = ^E<^> 2 > ^ = ^E(^+i) 2 (83) 

i i 

The evaluation of the theoretical predictions ()62I78|) involved solving the relevant 
functional eigenvalue equations numerically. For m and q, which both follow from (j62j) . 
one just needs to solve ((SDj) for Ao(0) = 1, which is straightforward (either by iteration, 
or using a population dynamics algorithm). The function ^(y) subsequently follows via 
identity f)41j) . We see in figure Q that for m and q the agreement between theory and 
experiment is excellent. Figure El shows the corresponding shapes of the distribution 
$(x) as well as the associated integrated distribution and the distribution W(m) of 
single-site magnetizations, which show the by now familiar characteristics of random 
field Ising models (see e.g. El El EI)- 

For those observables which require evaluation of (|78|) . and therefore numerical 
solution of the eigenvalue problems ()42l43j) for different values of p (which is feasible but 
extremely demanding in computing time), we have used the approximation consisting 
of replacing P p (. . .) and Q p (. . .) for p > by P (. . .) and Q (. . .), respectively. This 
would formally be allowed only in the non-disordered case (where also the assumed 
orthogonality of our eigenvectors within eigenspaces is correct), but is seen to give 
surprisingly accurate results even for those cases where the shape of these distributions 
is highly non trivial; see figures Q and El 
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m,q 



a 1 ,a 2 ,r 



weak 
Gelds 



medium 
fields 



strong 
fields 






t (iter/spin) 



t (iter/spin) 



Figure 1. Relaxation of obscrvables towards equilibrium at T = 1, in two random 
field Ising chains with identical disorder realizations, of size N = 20,000 and with 
field distribution p(6) = p8(9 — 9) + (1 — p)6(6 + 9). Left column: evolution of 
the magnetization m = -ZV -1 ^ "* an d the order parameter q — N^ 1 J2 i aia\. 
Right column: evolution of the multiple site quantities a\ = N~ 1 J2i cr i <7 i+i7 a 2 = 
A^ -1 J^i < J i< J i+2, and r = N^ 1 J^i ^i^i+i^Wi+i- Different rows correspond to different 
control parameters. Top row: weak random fields, with Jo = 1, 6 = 0.05, p = 0.7, 
where the theoretical equilibrium predictions are m ~ 0.14, q ~ 0.03, a\ ~ 0.76, 
a 2 ~ 0.58, r ~ 0.58. Middle row: intermediate fields, with J = 0.5, 6 = 0.2, p = 0.7, 
where our theory predicts m ~ 0.20, q ~ 0.08, ai ~ 0.47, a 2 — 0.22, r ~ 0.21. Bottom 
row: strong random fields, with J = 0.2, 9 = 2, p = 0.5, where the theory predicts 
the equilibrium values m ~ 0.006, q ~ 0.91, «i ~ 0.018, a 2 ~ 0.0003, r = 0.84. In all 
cases the predictions are indicated by markers at the right of the graphs. 
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W{m) 




.r 



Figure 2. Field distributions corresponding to the data of the previous figure ^ as 
obtained by numerical solution of our integral eigenvalue equation lj39J) via a population 
dynamics algorithm. The rows correspond to again to weak random fields (top row), 
intermediate random fields (middle row), and strong random fields (bottom row). 
Left column: The effective field distribution Q(x). Middle column: the integrated 
distribution $(a;) = dz <&(z). Right column: the distribution of single-site 
magnetizations W(m) = J dxdy ^(x)^(y)S[m — tanh(/3a; + @y)]. 



5. Applications of the theory: neural networks and 'small world' systems 

The theory in section El can be applied to any model which involves replicated transfer 
matrices. Here we demonstrate how it may be used to analyze models which are 
structurally different from the random field Ising model, in having not only short-range 
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but also long-range bonds. 

5.1. 1 + oo dimensional attractor neural networks 

We now turn to the attractor neural network described by the Hamiltonian (jSJ), where 
short range interactions compete with long-range ones. A detailed study of the 
model, based on the more conventional methods of El can be found in [To"! ITBj : 
here our objective is only to demonstrate how the present replicated transfer matrix 
diagonalization formalism can also be put to use in the context of such models. Upon 
introducing the p overlap order parameters m A1 (cr) = iV -1 each of which which 

measure the similarity between the system's microscopic configuration cr and a given 
stored pattern, one arrives after some standard manipulations at the following expression 
for the partition function 

Z = |dme^^ 3 +« (84) 
where m = (mi, . . . ,m p ), m 2 = J2/j m '? l -> an d r(m) = log R(m) with 

(J1...ITJV 

One may now calculate r(m) by regarding the random patterns as disorder and use the 
replica approach to calculate the disorder average. In the thermodynamic limit, r(m) 
(which is itself mathematically identical to the free energy per spin of a suitably defined 
chain) must be identical to its disorder average, with probability one. Therefore we 
consider 

1 1 

r(m) = lim — lim — log R n (m) 

In particular we have 

R n (m) = 2' pN v v rr e ^(°'i- o 'i+i)(^-^+i)+^( m -^)E«=i CT i < 

Sl'"SJV 

= tv(T N (m)) 

where cr, = (o~j, . . . , a"), and T(m) is a 2 np x 2 np transfer matrix with entries 

g(tr,tr'; m) = 2 -^^'(^')(^ ff ')^N)E: =1 ^ (86) 

In order to determine the largest eigenvalue of this replicated transfer matrix we make 
the by now familiar type of ansatz for the its left and right eigenvector: 

u^(tr) = fdy * £{y\n)e pv ^=^ a u^(ct) = fdx ^(x\n)e^^=i aa (87) 

Our motivation for this particular choice of the dependence on the pattern vectors £ 
is that for p — 1 the dependence on the remaining pattern can be transformed away 
by the gauge transformation <Tj — > £j<7V This would leave a replicated transfer matrix 
of an Ising chain with constant bonds, where the role of the external field is played by 
Jim. Thus for p = 1 the present eigenvectors must reduce to those as studied in section 
Secondly, the group (j%7|) obviously represents only a subset of all eigenvectors (to 
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be precise: the p = family, in the language of the previous section). Building the full 
set is straightforward, but here we restrict ourselves for brevity to the main ones, i.e. 
those which control the free energy and the single-site observables (the others only play 
a role when calculating multiple-site observables). 

Having introduced our eigenvectors, we proceed as in the random field Ising model, 
adding m as a conditioning label wherever needed. We then find in the limit n — > that 
A(0; m) = 1, that our final eigenvalue problems are defined in terms of joint field-pattern 
distributions: 

vMy|0) = 2-* W dy' *M\0) 5[y - A(J s (t ■ £'),y' + J e (m • £'))] (88) 

S £ (x|0) = 2-* W dx' *M\0) 6[x - J e (m ■ £) - A(J S (£ ■ £'),*')] (89) 

These distributions are normalized according to fdx $^(rr|0) = fdy tyg(y\0) = 1 for 
all £. The actual value to be inserted for the vector m in the above expressions is 
to be solved from the saddle-point equations which determine the stationary point of 
the extensive exponent in the partition sum. This equation can simply be written as 
m = limAr^oo AT -1 J2i )■ Upon repeating the steps taken earlier in solving the 
random field Ising model, we get: 



m,, = lim 



tr(S» 1} T N (m)) 



"-" mT v (m)> 



= ^ P Y.j dxdy^(x|0)^(y|0)e M tanh(/3x + /3y) (90) 
in which is a diagonal 2 np x 2 np matrix with elements: 

The n = eigenvalue problems for $^ and are coupled to the saddle point 
equations for the 'mean field' order parameters. This feature is typical, within the 
replica formalism, for all models where a one-dimensional structure is embedded in a 
mean-field (or range-free) architecture, as is the case here. 

In order to calculate the free energy we need to know the 0(n) contribution A(m) 
to A(n; m) (i.e. A(n; m) = 1 + n\(m) + 0(n 2 )). The latter can be expressed in terms 
of the n = effective field distributions, and is found to be given by: 

A(m) = 2- 2p ]T [dy ^(y|0)/?fl(J.(£ • €),y + Je(m ■ O) 
W 

Hence 

X i 

rim) — lim — lim — log X N (n;m) 

= lim - log[l + n\(m) + 0(n 2 )} = A(m) (91) 
Substitution of this result for r(m) into the partition leads to to our final result 

/ = \j t m 2 - TX(m) (92) 
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Figure 3. Relaxation of observables towards equilibrium at T = J = 1, in 
two 'small world' ferromagnets with identical realizations of the disorder (i.e. the 
Poissonnian graph), of size N = 20,000. Left column: evolution of the magnetization 
m = iV _1 <Tj and the order parameter q = N^ 1 UiCT^. Right column: evolution 
of the multiple site quantities d\ — N~ 1 '^ i o i o i+ i, a 2 — N^ 1 ^ i a i a i+ 2, and 
r = N~ 1 ^2 i <7i(Ti+i<j / i a' i+1 . Different rows correspond to different control parameters. 
Top row: high Poissonnian connectivity, viz. J = 0.25 and c = 4, where the predicted 
equilibrium values are m ~ 0.75, q ~ 0.58, ai — 0.62, a 2 — 0.57, r ~ 0.40. Bottom 
row: low Poissonnian connectivity, viz. Jq — I and c = 0.5, where the theory predicts 
m ~ 0.88, q ~ 0.80, a ~ 0.85, a2 ~ 0.81, r ~ 0.74. In all cases the predictions are 
indicated by markers at the right of the graphs. 



in which m is given by the solution of (J§U|) . The link with the results of [13] is can now 
be established upon defining a new random variable k, which in ^H] represents the ratio 
of conditioned partition functions, and is subject to a random non-linear map as one 
builds up the chain iteratively from iV = 1 to iV = oo. With the following definition 
the two solutions (the one in ^H] and the one in this paper) become fully identical: 

P(k,Q = 2->J dy^^y)5[k-e- 2 ^} (93) 
5. 2. 1 Small-world ' ferromagnets 

Our final application example is the so-called 'small- world' ferromagnet, defined by the 
Hamiltonian (J2J. As in the previous example this model represents a combination of one- 
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W(m) 
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Figure 4. Field distributions corresponding to the data of the previous figure 
obtained by numerical solution of our integral eigenvalue equation lj39J) via a population 
dynamics algorithm. The rows correspond to examples with high (top row) and low 
(bottom row) Possonnian connectivity. Left column: The effective field distribution 
$(a;). Middle: the integrated distribution $(x) = dz $(z). Right: the distribution 
of single-site magnetizations W(m) = f dxdy ^(x) i S(y)8[m — tanh(/3x + (3y)}. 



dimensional short-range interactions and long-range ones. In contrast to the previous 
example the long-range bonds are not 'all-to-all', but represent a finitely connected 
Poissonnian random graph. This model was studied in more detail in [Fl\, where it 
was shown that application of the replica formalism generates the following replicated 
transfer matrix, with cr, cr', r G { — 1, 1}": 

T(<r,o>\P) = ^^Et^^IH- 8 (94) 

Here the mean-field order parameter is a function P(t), which gives the fraction of 
sites where the replicated spin o-j equals r. The saddle-point equations are here found 
to take the form of an expression for P(t) in terms of those eigenvectors of T which 
correspond to the largest eigenvalue: 

= "°frH(r) (95) 

(assuming this eigenspace to be non-degenerated, similar to our previous models). In this 
model one expects a replica symmetric solution (RS) to describe the physics correctly, 
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which for the order parameter P(t) implies the form 

p ^ = h wih >i^Sw (96) 

Insertion of this RS expression into (|94|) results in the following replicated transfer 
matrix: 

T RS (a, a') = J AO p(6\n) e^er-a'+pe^^ (97) 

-c k f k jl W(h ) e n/3B(J/c,h r ) 

mn) = E ^ / { II HP - E AW* M (98) 

Again we observe that our replicated transfer matrix may be viewed as equivalent to 
that of a one-dimensional chain with suitably chosen random fields. The associated 
'distribution' of these fields represents the overall effect within the system of the sparse 
Poissonian long range bonds on a given site of the ring. We note that p(8\n) is normalized 
only for n = 0. 

Having identified the structure of our RS replicated transfer matrix, one may 
proceed to solve this model using the eigenvectors introduced in section 13.31 As in 
the Ising chain, this results in a transformation of the eigenvalue problem to integral 
equations, viz. ()29|3()|) and (j31|32|) . involving now the above field distribution p{6\n). 
In addition the integral eigenvalue equations become coupled with the new distribution 
W(h) in (j9fijl . which may be viewed as the fundamental 'mean-field' order parameter in 
this model. In the limit n — > one finds that W(h) is given by 

W(h) = J dxdy <$>{x)^{y)5(h -x-y) (99) 

In order to find also correlation functions in the present model we return to the previous 
derivation in section 0] and invoke the identity: 



(a iaj )p = lim < 1(r T ■ ■ ■ ° a i P °7 II e- m{(ja) 

n ~*° {<J} a=l 

We find, after some straightforward and by now standard manipulations (viz. averaging 
over the disorder, insertion of the relevant order parameters, and use of saddle point 
equations) that correlation functions can be again written in the form 

where P is now given by expression ()9f)j1 . Since the steps which led us earlier for the 
random field Ising chain to (|78j) apply again, we may simply use (|75j) again to find 
also the correlation functions for the present model. The results of solving the relevant 
order parameter equations numerically (via population dynamics algorithms) are shown 
in figure El where we show the predicted equilibrium values for the scalar observables 
(I82p83j) together with the corresponding measurements in numerical simulations, for 
comparison. The corresponding effective field distributions are shown in figure 0] As 
with the random field Ising model, the order parameter functions required for the 
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calculation of m and q have been calculated using the exact equations, whereas those 
required for the multiple-site observables {ai,a 2 ,r} have been solved approximately. 
This is borne out by figure El which indeed shows excellent agreement between theory 
and simulations for m and q (left column), but deviations for the three quantities that 
have been calculated in approximation (right column). 

6. Discussion 

In this paper we have developed new tools for the diagonalization of replicated transfer 
matrices, which arise upon applying the replica method to disordered models with one- 
dimensional short-range bonds, possibly in combination with (random) long range ones. 
Our method was based on mapping the problem of diagonalizing 2 n x 2 n matrices which 
are invariant under the replica permutation group onto the problem of diagonalizing 
appropriate n-dependent integral operators, in which the limit n — > can be much 
more easily taken, via a suitable ansatz for the eigenvectors. The result, similar to that 
obtained earlier via more traditional methods, is an integral eigenvalue problem, which 
is exact in the relevant limits N —>■ oo and n — > 0, but which has to be solved numerically 
(using e.g. population dynamics). Given our explicit expressions for the eigenvectors, 
the route is open to the evaluation of the free energy and several families of disorder- 
averaged observables, including the magnetization and the spin-glass order parameter, 
but also multiple-site correlation functions. It should be emphasized, however, that to 
evaluate the latter types of objects we had to make two simplifying assumptions, for 
which the only basis as yet is their validity in simpler and thereby verifiable cases. 

We have developed our theory in full detail for the random field Ising chain, and we 
showed subsequently how the solution of other more complicated models can be obtained 
from this, especially those where short-range bonds are combined with long-range ones 
and where one effectively ends up with a random field Ising problem embedded within a 
mean-field calculation. In particular we have worked out our equations and predictions 
for 1 + oo- dimensional recurrent neural networks, and for 'small world' ferromagnets. 

Possible future applications of the approach presented in this paper would be to 
the analysis of two-dimensional disordered spin systems, or to models which require 
finite— n replica calculations (e.g. those where the disorder is not truly frozen, but 
slowly and stochastically evolving in time), or to situations where one has RSB (broken 
replica symmetry) in 1 + oo dimensional or 'small-world' spin systems. The latter 
two calculations would not seem to be easily carried out using the more conventional 
random field methods as in e.g. [HUH], but would appear to be feasible extensions of the 
procedures presented here. 
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Appendix A. Combinatorial terms in the n —>■ limit 

Here we prove identity (|77jl . We note that the natural continuation of factorials to non- 
integer values is via the Gamma function viz- n\ = T(n + 1). For integer p > 1, 
integer i > and real- valued n < 1 (so that always £ > n — p + 1) we may therefore 
write 



n — p\ 1 f^°dx x n p e x 
t ) = J\ 40 Jfdx x n -P- £ e~ x 

1 , \}dx x n - p e~ x + O(e ) 
= — hm — — — 

i\ 40 f]dx x n -P- £ e~ x + O(e ) 

l w-p-l+1 e n - p+1 + Q(e°) 
~ I\ n-p+1 40 e n-p-£+i + o(e°) 



We are left only with the case £ = 0, for which the above factorial terms would be equal 
to one. This proves (|77j). 



ln-p-l + P. e e + 0(e £+p - n - 1 ) 

hm 

£\ n-p+1 40 1 + 0{e^P- n ~ l ) 







(A.l) 



